Skip to content

feat(encryption): support AES-256 keys for reading Parquet data files - #2878

Merged
blackmwk merged 3 commits into
apache:mainfrom
mbutrovich:feat/encryption-aes-256-parquet
Jul 23, 2026
Merged

feat(encryption): support AES-256 keys for reading Parquet data files#2878
blackmwk merged 3 commits into
apache:mainfrom
mbutrovich:feat/encryption-aes-256-parquet

Conversation

@mbutrovich

Copy link
Copy Markdown
Collaborator

Which issue does this PR close?

  • Closes #.

Depends on the arrow-rs 58.4.0 release tracked in apache/arrow-rs#10349.

What changes are included in this PR?

  • Bump arrow/parquet deps from 58 to 58.4. arrow-rs 58.4.0 adds AES-256 for Parquet modular encryption (58.3.0 was AES-128 only), landed via [parquet] Allow more encryption algorithms arrow-rs#9203.
  • Add an AES-256 encrypted-Parquet read test. Refactored the existing 128-bit test into a shared assert_encrypted_parquet_roundtrip(key) helper with _aes_128 and _aes_256 callers.

Note: 192-bit is not supported for data files. arrow-rs uses ring, which has no AES-192-GCM. Can revisit later.

Are these changes tested?

Yes. Unit test test_read_encrypted_parquet_aes_256 writes and reads back a 256-bit encrypted Parquet file. It fails on arrow-rs 58.3.0 (ring rejects the 32-byte key) and passes on 58.4.0.

@mbutrovich mbutrovich changed the title feat(encryption): add 256bit data file key test, bump arrow-rs to 58.4 in supportw feat(encryption): add 256bit data file key test, bump arrow-rs to 58.4 in support Jul 22, 2026
@mbutrovich mbutrovich changed the title feat(encryption): add 256bit data file key test, bump arrow-rs to 58.4 in support feat(encryption): add 256bit data file key test, bump arrow-rs to 58.4.0 in support Jul 22, 2026
@mbutrovich mbutrovich changed the title feat(encryption): add 256bit data file key test, bump arrow-rs to 58.4.0 in support feat(encryption): support AES-256 data file key, bump arrow-rs to necessary 58.4.0 Jul 22, 2026
@mbutrovich mbutrovich changed the title feat(encryption): support AES-256 data file key, bump arrow-rs to necessary 58.4.0 feat(encryption): support AES-256 keys for Parquet data files Jul 22, 2026
@mbutrovich mbutrovich changed the title feat(encryption): support AES-256 keys for Parquet data files feat(encryption): support AES-256 keys for reading Parquet data files Jul 22, 2026

@xanderbailey xanderbailey left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Awesome stuff! Thanks Matt!

@hsiang-c hsiang-c left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @mbutrovich

@blackmwk blackmwk left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @mbutrovich for this pr!

@blackmwk
blackmwk merged commit 4532da8 into apache:main Jul 23, 2026
22 checks passed
@mbutrovich
mbutrovich deleted the feat/encryption-aes-256-parquet branch July 23, 2026 10:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants